Occlusion Reasoning for Temporal Interpolation using Optical Flow
نویسندگان
چکیده
We present an optical-flow-based algorithm to smoothly interpolate between two images. We reason about the depth ordering of objects, and show how bidirectional flow can be used to reduce holes in the estimated flow at the interpolated time and perform occlusion reasoning. We develop a purely pixel-wise algorithm and then add spatial regularization. We evaluate our algorithm on the interpolation set of the Middlebury flow benchmark.
منابع مشابه
Tracking Multiple Indistinguishable Objects through Severe Occlusion
Occlusions are one of the biggest obstacles to reliable tracking. While many existing algorithms perform well while the objects of interest are separated, they often swap object identities when multiple objects occlude one another. We focus on the problem of tracking multiple, nonrigid targets through severe occlusions. Our occlusion reasoning algorithm takes advantage of reliable separated obj...
متن کاملSuper SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolation
Given two consecutive frames, video interpolation aims at generating intermediate frame(s) to form both spatially and temporally coherent video sequences. While most existing methods focus on single-frame interpolation, we propose an end-to-end convolutional neural network for variable-length multi-frame video interpolation, where the motion interpretation and occlusion reasoning are jointly mo...
متن کاملContext-aware Synthesis for Video Frame Interpolation
Video frame interpolation algorithms typically estimate optical flow or its variations and then use it to guide the synthesis of an intermediate frame between two consecutive original frames. To handle challenges like occlusion, bidirectional flow between the two input frames is often estimated and used to warp and blend the input frames. However, how to effectively blend the two warped frames ...
متن کاملSuper-resolution reconstruction using spatio-temporal filtering
It has been known for some time that temporal dependence (motion) plays a key role in the super-resolution (SR) reconstruction of a single frame (or sequence of frames). While the impact of global time-invariant translations is relatively well known, the general motion case has not been studied in detail. In this paper, we discuss SR reconstruction for both motion models from a frequency-domain...
متن کامل3D Reconstruction of Dynamic Scenes with Multiple Handheld Cameras Supplementary Material
Most previous methods such as [3, 1] simply enforced temporal coherence constraint individually on each single camera for depth refinement. Disparities of corresponding pixels across multiple frames were smoothed using linear interpolation or curve fitting. This optimization method is not robust as shown in Fig. 1(c), because a simple smoothing does not essentially help the inference of true di...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2009